例句與造句

1. A draft specification for Robots exclusion standard rules inside XML documents uses processing instructions.
2. Robots exclusion standard tells me that this code tells all robots to stay away.
3. :: The questioner is referring to the robots exclusion standard, not a specific query.
4. :: To avoid triggering any defense mechanisms, check for a robots exclusion standard ( GET / robots . txt ).
5. The explanation for the links going dead is that Kilz had blocked web spiders via robots . txt, the Robots Exclusion Standard.
6. It's difficult to find robots exclusion standard in a sentence. 用robots exclusion standard造句挺難的
7. Dotbot obeys the Robots exclusion standard, the user-agent string of Dotbot is " DotBot / 1.1 ".
8. Unlike crawlers such as Wayback Machine, archive . is only captures individual pages in response to explicit user requests, and so does not obey the robots exclusion standard.
9. Koster, also created the Robots Exclusion Standard, used to prevent cooperating web crawlers and other web robots from accessing all or part of a website which is otherwise publicly viewable.
10. Robots . txt is used as part of the Robots Exclusion Standard, a voluntary protocol the Internet Archive respects that disallows bots from indexing certain pages delineated by its creator as off-limits.
11. Martijn Koster, who was also instrumental in the creation of the Robots Exclusion Standard, detailed the background and objectives of ALIWEB with an overview of its functions and framework in the paper he presented at CERN.
12. The User-Agent string is one of the criteria by which Web crawlers may be excluded from accessing certain parts of a Web site using the Robots Exclusion Standard ( " robots . txt " file ).
13. Archive . is does not abide by the Robots exclusion standard, while other archivers do : WayBack Machine uses it to avoid archiving material which site owners do not want archived, and WebCite uses it to address " copyright issues ".
14. In 2006, tensions developed between the job boards and several scraper sites, with Craigslist banning scrapers from its job classifieds and Monster . com specifically banning scrapers through its adoption of a robots exclusion standard on all its pages while others have embraced them.
15. If they don't want to grant access they can use the Robots Exclusion Standard to block it ( relying on the assumed good behaviour of bingbot ), or use other server specific means ( relying on the web server to do the blocking ).
16. To that end, WebCite will not archive in violation of Web site " do-not-cache " and " no-archive " metadata, as well as robot exclusion standards, the absence of which creates an " implied license " for web archive services to preserve the content.
更多例句：  下一頁